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METHOD AND APPARATUS FOR TESSELLATION LIGHTING 



Field of the Invention 



10 



The invention relates generally to video graphics processing and more particularly 
to a method and apparatus for tessellation lighting of video graphics primitives. 



Video graphics display systems commonly utihze primitives, often in the form of 
triangle primitives, to model objects to be drawn to a displayed image. Modeling the 
object to be drawn using primitives often requires a number of primitives in order to 
accurately represent three-dimensional objects. Each of these primitives includes a 
20 number of parameters corresponding to each of the vertices of the primitive. The 

parameters include color and alpha blending values, as well as spatial coordinates and 
normal vectors that may be used for calculating lighting effects that aid in accurately 
representing the object in the displayed image. 



25 video graphics primitive^are calculated and then interpolated across the primitive in order 
to determine the specific cotor and alpha values for each pixel included in the primitive. 
Determination of the color vames at the vertices of the primitive could include calculating 
lighting effects based on one or nWe lighting sources that may affect the color at the 
vertices. An equation commonly used for determination of vertex color values such that 

30 lighting effects are included is: \ 



Backffl-ound of the Invention 



In prior art systems, the color and alpha blending values at each vertice of the 



• # 



Vertex_color = emissivejcolor + (ambient Jight x ambient material _color ) 

+ {range) x {spot _ atten,) x [{ambient _ //gA^ x ambient _ material _ color) 

+ (« • L){diffuse _ light x diffuse _ material _ color) 

+ (? • n){specular _ light x specular _ material _ co/or)] 

wherein the summation portion has a component corresponding to each Ught 
source that is relevant. 

As the equation illustrates, the vertex color values are a function of a number of 
different factors. Such factors are well known in the art, and the calculations required to 
determine the vertex colors are also well known. As the equation indicates, some of the 
factors are dependant on the normal vector {n) that corresponds to the particular vertex. 
Such normal vectors represent a vector that is normal to the surface of the object at the 
point where the vertex is located. 

Problems can arise when large video graphics primitives are drawn that include 
hghting effects that are dependent on the normal values at the vertices. This is because 
prior art video graphics systems commonly interpolate the vertex color and alpha values 
across the entire primitive in order to determine the specific color and alpha values for 
each pixel within the primitive. Because the Ughting effects are only calculated at the 
vertices, the shading produced by such lighting effects will be linearly spread across such 
large primitives, often reducing the realism with which the object is rendered. Such prior 
art interpolation of vertex color and alpha values to determine specific pixel color and 
alpha values is commonly referred to as Gouraud shading. 

In order to avoid some of the detrimental effects on the shading of the primitive 
due to interpolation, another prior art technique for calculating lighting effects commonly 
known as Phong shading is used. Phong shading recalculates a normal value for each 
pixel location prior to determining the specific color and alpha values for that specific 
location. Although Phong shading produces better results than Gouraud shading, the 
processing bandwidth required to implement full-scale Phong shading is relatively large, 
and therefore Phong shading is impractical in most video graphics systems as it is too 




expensive to implement. 

Therefore, a need exists for a method and apparatus for performing Ughting 
operations with respect to primitives that improves on the coarse granularity of Gouraud 
shading while reducing the processing bandwidth requirements in comparison with those 
5 corresponding to Phong shading. 



Brief Description of the Drawings 

10 Figure 1 illustrates a flow diagram of a method for video graphics processing in 

accordance with a particular embodiment of the present invention; 

Figure 2 illustrates a graphical representation of a video graphics primitive with 
corresponding normal vectors; 

Figure 3 is a graphical representation of the video graphics primitive of Figure 2 
1 5 following tessellation; 

Figure 4 provides a graphical representation of the video graphics primitive of 
Figure 3 where normal vectors are calculated for some of the component primitives 
resulting from tessellation in accordance with a particular embodiment of the present 
invention; and 

20 Figure 5 illustrates a block diagram of a video graphics processing circuit in 

accordance with a particular embodiment of the present invention. 

Detailed Description 

25 Generally, the present invention provides a method and apparatus for performing 

tessellation lighting operations for video graphics primitives in a video graphics system. 
When the vertex parameters corresponding to the vertices of a video graphics primitive 
are received, a tessellation operation is performed such that a number of component 
primitives are generated. The vertex parameters corresponding to the vertices of the 



component primitives are then calculated utilizing the vertex parameters for the original 
video graphics primitive. Such calculation operations include determining a 
corresponding normal vector for each component primitive vertex. Each of the 
component primitives is then individually processed. Such processing may include 
5 calculating the lighting effects for each component primitive and performing additional 
processing operations that generate pixel fragments for the primitive. The resulting pixel 
fragments are blended with image data stored in a frame buffer, where the image data is 
used in generating a displayed image. 

By tessellating video graphics primitives prior to performing lighting and 

10 subsequent processing operations, better Hghting effects are achieved than those 

associated with Gouraud shading. At the same time, the processing bandwidth required 
to perform such improved lighting does not require the large amounts of processing 
bandwidth associated with Phong shading. Furthermore, the level with which individual 
video graphics primitives are tessellated can be controlled such that only larger or more 

15 complex video graphics primitives are tessellated for lighting operations. As such, 
overall display quality is improved while limiting the additional processing bandwidth 
required. 

The invention can be better understood with reference to Figures 1-5. Figure 1 
illustrates a flow diagram of a method for video graphics processing that includes 

20 performing tessellation operations for processing applications such as lighting operations. 
The method begins at step 102 where vertex parameters corresponding to vertices of a 
video graphics primitive are received. The vertex parameters for each vertex may include 
three-dimensional (3D) coordinates corresponding to the vertex and a normal vector that 
represents a normal to the surface of the object for which the video graphics primitive is a 

25 part. The vertex parameters may also include a base color value that can be modified by 
lighting calculations that may be based on the location and direction of light sources and 
the particular normal vectors corresponding to each of the vertices as described earlier. 

Figure 2 illustrates a video graphics primitive 10, which is a triangular video 
graphics primitive. The video graphics primitive 10 is defined by vertices 12-14. Each 

-4- 




vertex is shown to have a corresponding normal vector 62-64, respectively. In prior art 
Gouraud shading techniques, the normal vectors 62-64 would be used to calculate the 
lighting effects for the primitive 10 at each of the vertices 12-14. These Hghting effects 
would then be linearly interpolated across the entire primitive 10 to produce the resulting 
5 color values for each of the pixels. However, as described above, this can produce very 
linear shading, which is often undesirable in the display of video graphics images. 

At step 104, the video graphics primitive is tessellated to produce a plurality of 
component primitives. The plurality of component primitives is defined by a plurality of 
additional vertices and the vertices of the original video graphics primitive. Figure 3 
10 illustrates the primitive 10 following tessellation, where in the example illustrated, the 
level of tessellation has resulted in 15 component primitives 21-36. Each of the 
component primitives 21-36 is defined by component vertices, where each component 
"5 vertex has a corresponding set of component vertex parameters. For example, the 

J^J component primitive 21 is defined by the component vertices 42 and 43 as well as the 

CO 

in 15 original primitive vertex 12. The component vertex parameters corresponding to each 
il component vertex preferably include a set of 3D coordinates and a component vertex 

'•^ normal vector. Additional parameters, such as a base color value may also be included in 

C3 each set of component vertex parameters. The component vertex parameters are derived 

Cn 

f 3 firom the original primitive vertex parameters corresponding to the primitive vertices 12- 

U 20 14. 

C3 Returning to Figure 1, step 106 includes the calculation of the additional normal 

vectors corresponding to each of the additional vertices that are created through 
tessellation. The additional normal vectors may be calculated at each component vertex 
utilizing interpolation techniques, where in one embodiment, linear interpolation is used 
25 to calculate the additional normal vectors. In other embodiments, more complex 
calculations can be performed such as Nth order interpolation, where N is a number 
greater than one. For example, in one embodiment, a quadratic interpolation operation 
may be utilized to calculate the additional normal vectors. More complex interpolation 
may be utilized to achieve better approximations of the normal for the object to which the 
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original primitive corresponds at the locations corresponding to each of the component 
vertices that have been created through tessellation. Following calculation of the 
additional normal vectors, these normal vectors may be re-normalized prior to use in 
lighting calculations. 

Referring to Figure 4, the component vertex normal vectors 72-74 are shovra. 
The component vertex normal vector 72 corresponding to the component vertex 42 may 
be calculated by at least interpolating between the primitive vertex normal vector 62 and 
the primitive vertex normal vector 63. Similarly, the component vertex normal vector 73 
may be determined through interpolation between the primitive vertex normal vector 62 
and the primitive vertex normal vector 64. The component vertex normal vector 74 can 
be calculated as a function of each of the primitive vertex normal vectors 62-64. 

The component vertex normal vectors 72-74 all correspond to the component 
primitive 23. The component vertex normal vector 72 and 73 are also component vertex 
normal vectors corresponding to the component primitive 21, which is also defined by the 
primitive vertex normal vector 62 corresponding to the original primitive. As such, 
performing the calculation steps required to determine the component vertex normal 
vectors 72 and 73 need only be performed once, and the resulting normal vectors 72 and 
73 can be used for subsequent processing operations corresponding to each of the 
component primitives 21 and 23. As can be seen by referring to Figure 3, the component 
vertex parameters corresponding to many of the component vertices resulting from 
tessellation of the primitive 10 can be reused for multiple component primitives. 

Once the component vertex parameters are determined for each of the component 
primitives, where the component vertex parameters can include component vertex normal 
vectors, 3D coordinates, and base color values for the component primitives, each of the 
component primitives can be processed as if it were a typical video graphics primitive 
generated through other means within the system. However, by breaking up the original 
primitive into a plurality of component primitives, the coarseness with which lighting 
effects or other processing operations are performed can be reduced such that a better 
resulting image is produced. 



• • 

Referring back to Figure 1, step 108 includes the addition of lighting effects to the 
component primitive parameters for each of the component primitives. This may include 
calculating vertex lighting effects at each of the component vertices for the component 
primitives. Once the lighting effects for each component primitive vertex have been 
calculated, subsequent processing utilizing a 3D graphics pipeline at step 110 will cause 
the resulting pixel data produced to include lighting effects at each pixel location that 
have been calculated based on the vertex data that includes the lighting effects added at 
step 108. 

The lighting effects added at step 108 may include the addition of specular 
lighting effects, diffuse lighting effects, or environment mapping lighting effects. Each 
of these different types of lighting effects corresponds to a different portion of the 
equation listed in the background section above. Diffuse lighting effects are those 
lighting effects that are not dependent upon the positioning of the viewer of the object 
being rendered. Examples include shadows or general illumination of the object. 
Specular lighting is based on the relative positioning of the viewer with respect to the 
object for which the lighting effects are being determined. An example would include the 
viewing of a shinny spot on a spherical structure corresponding to a particular point light 
source, where such a spot would track along the surface of the ball if the position of the 
viewer were to move. Environment mapping lighting effects are those lighting effects 
that reflect the environment within which the object being drawn exists. Such lighting 
effects include spherical, dual parabolic, and cubic environment mapping effects. 

The processing performed at step 110 using the 3D video graphics pipeline can 
include functions commonly performed by blocks such as a setup engine, a raster engine, 
a pixel pipe, and a render backend block. In such a system, the setup engine produces 
primitive slope information based on the component primitives. The slope information is 
then provided to a raster engine that generates pixel fragments from the primitive slope 
information. Such rasterization performs the calculations that generate the pixel data 
such that it includes the lighting effects generated at step 108. For example, if the 
lighting effects alter the original color values associated with a particular component 
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primitive, rasterization of that component primitive will be based on these modified color 
values such that the lighting effects generated for the individual vertices of the 
component primitive are used in determination of the color values for each of the pixel 
location. This is similar to the Gouraud shading operations described earlier. 
5 After rasterization, the pixel fragments are provided to a pixel pipe that performs 

various operations that may modify the color of the pixel fi'agments as received firom the 
raster engine. Such operations can include texture mapping operations, where texture 
coordinate data may also be included in the vertex parameters corresponding to the 
original video graphics primitive. Following the processing within the pixel pipe, the 

10 fragments are passed to a render backend block, which blends the firagment data with 
pixel data already stored for a display frame in a fi^ame buffer such that the contributions 
of the component primitive to the overall displayed image are included. Such blending 
operations performed by the render backend block are well known in the art. 

Figure 5 illustrates a block diagram of a video graphics circuit 200 that includes a 

15 central processor 210, a control processor 220, a tessellation block 230, a lighting block 
240, a 3D pipeline 260, and a fi-ame buffer 250. The central processor 210 generates 
processing commands and vertex parameters corresponding to video graphics primitives 
that are to be rendered to a display fi-ame. 

The control processor 220, which is operably coupled to the central processor 210, 

20 receives the processing commands from the central processor and generates control 

information based on the processing commands. Such control information may include 
specific portions directed to each of the tessellation block 230, the lighting block 240, and 
the 3D pipeline 260. Such control information may relate to the specific marmer with 
which a particular video graphics primitive generated by the central processor 210 is to be 

25 processed by these corresponding circuit components. 

The tessellation block 230, which is operably coupled to the central processor 210 
and the control processor 220, receives a first portion of the control information from the 
control processor 220. The tessellation block 230 receives vertex parameters 
corresponding to each of the vertices for each video graphics primitive produced by the 
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central processor 210. Depending on the control information received from the control 
processor 220, the tessellation block 230 may or may not tessellate each video graphics 
primitive that it receives. Furthermore, when the tessellation block does tessellate a video 
graphics primitive to produce a plurality of component primitives, the number of 
component primitives produced may be based on a tessellation level that is included in 
the control information that it receives. The control information that it receives 
corresponding to tessellation operations may be referred to as tessellation information. 

When the tessellation block 230 tessellates a video graphics primitive to produce 
a plurality of component primitives, component vertex parameters are generated by the 
tessellation block 230 for each of the vertices corresponding to the plurality of component 
primitives. Such component vertex parameters can include color values, 3D coordinates, 
and vertex normal vectors. Such calculations may be performed using linear 
interpolation or Nth order interpolation as described above. As stated earlier, quadratic 
interpolation may be useful for calculating normal vectors as it provides a more accurate 
result than linear interpolation. 

The lighting block 240, which is operably coupled to the control processor 220 
and the tessellation block 230, receives component vertex parameters corresponding to 
each of the component primitives generated by the tessellation block 230. The lighting 
block 240 also receives a second portion of the control information from the control 
processor 220, where such control information may indicate whether or not any lighting 
effects, and also what type of lighting effects, should be added to individual component 
primitives. Based on the control information received, the lighting block 240 adds 
lighting effects to the component vertex parameters for each of the component primitives 
to produce modified vertex parameters. Such lighting effects may include diffuse 
lighting effects, specular lighting effects, and environmental mapping lighting effects as 
described above. 

The 3D pipeline 260, which is operably coupled to the control processor 220, the 
lighting block 240, and the frame buffer 250, receives the modified vertex parameters for 
each of the component primitives. The 3D pipeline 260 processes each of the component 




primitives to generate pixel fragment data that are blended with pixel data currently 
stored for the frame in the frame buffer 250. The 3D pipeline 260 individually processes 
each of the component primitives such that the specific lighting effects generated for each 
component primitive by the lighting block 240 directly influence the resulting colors for 
the individual pixel locations within the overall video graphics primitive which has been 
tessellated. As such, more accurate lighting effects that improve on the coarser effects 
that would normally be generated without tessellation are achieved. 

As is apparent to one of ordinary skill in the art, when 3D processing operations 
performed within the 3D pipeline utilize the normal vectors corresponding to each of the 
vertices of the individual component primitives, more accurate results may also be 
achieved such that the tessellation may be beneficial for applications aside from lighting. 
It should also be noted that various memory and buffer structures may be included in the 
video graphics circuit 200 to facilitate the efficiency with which the video graphics circuit 
200 operates. For example, memory or buffering may be included between the central 
processor 210 and the control processor 220 as well as between the central processor 210 
and the tessellation block 230 to allow the central processor 210 to issue processing 
commands and vertex parameters corresponding to a number of video graphics primitives 
in a short period of time in order to allow the central processor 210 to perform other 
processing functions. The memory or buffers may be accessed by the control processor 
220 and the tessellation block 230 to retrieve the data associated with individual video 
graphics primitives for processing. 

In the foregoing specification, the invention has been described with reference to 
specific embodiments. However, one of ordinary skill in the art appreciates that various 
modifications and changes can be made without departing from the scope of the present 
invention as set forth in the claims below. Accordingly, the specification and figures are 
to be regarded in an illustrative rather than a restrictive sense, and all such modifications 
are intended to be included within the scope of present invention. 

Benefits, other advantages, and solutions to problems have been described above 
with regard to specific embodiments. However, the benefits, advantages, solutions to 

. -10- 



problems, and any element(s) that may cause any benefit, advantage, or solution to occur 
or become more pronounced are not to be construed as a critical, required, or essential 
feature or element of any or all the claims. As used herein, the terms "comprises," 
"comprising," or any other variation thereof, are intended to cover a non-exclusive 
inclusion, such that a process, method, article, or apparatus that comprises a list of 
elements does not include only those elements but may include other elements not 
expressly listed or inherent to such process, method, article, or apparatus. 
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